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Method and system for identifying optimal image within a series of unages that 

depict a moving organ 

FIELD OF THE INVENTION 

This invention relates to medical ims^e processing devices. 

BACKGROUND OF THE INVENTION 

Medical imaging devices are often used to image moving organs. Cardiac image 
5 processing devices, in particular, are always used to image moving organs, either the heart 
(via ultrasound imaging for example), or the coronaries (via angiography for example). 
Many of these imaging processing devices are used to quantify the motion either as an 
indication by itself or as part of an image-processing algorithm. 

An image processing device for Left Ventricle Analysis is used to evaluate 
10 Ejection Fraction, which is the percentage of the blood pumped out during each heartbeat 
Left Ventricle Analysis involves computing the Left Ventricle volume from an angiogram 
(taken from a cine-angio sequence of images). The Left Ventricle volume is computed 
once for the heart in its systolic phase and once for the heart in its diastolic phase. Ejection 
Fraction is estimated from the ratio of these volxmes. Identifying the systolic and diastolic 
1 5 images is part of the LVA procedure. 

Myocardium thickness and Heart Wall Motion are evaluated from Ultrasound 
Images to indicate heart failure conditions. Both procedures, again, involve the 
identification of systolic and diastolic instances. F\jrthermore, quantifying the object's 
motion could be directly used for Wall Motion evaluation. 
20 Intra-Vascular Ultrasound (IVUS) is a method of evaluating and analyzing 

coronary defects by means of inserting an intra-vascular ultrasound device and imaging the 
vessel. IVUS measurements include measurements of the liuninal vessel area. Estimation 
of the luminal area very much depends on the heart phase and results vary for different 
images depicting different stages within the cardiac cycle. Again, it is usefiil to identify the 
25 diastolic - or the minimal movement instance - in order to perform measurements on the 
optimal image. 
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CT, MRI and PET are also used to image the heart as well as the coronary 
arteries. These methods use ECG triggering that synchronize image acquisition to ECG 
events (for example end diastole) in order to decrease motion artifacts tiiat decrease image 
resolution and image quality, thus impairing the image result and consequently clinical 
5 assessments. 

In the field of medical imaging, angiography is a gold standard for cardio- 
vascular diagnostics. Conventional (2D) angiography, produced by C-Arm X-ray 
eqmpment, applied during a catheterization procedure, provides a most accurate modality 
for evaluating vessel disease. Quantitative Coronary analysis is often applied to measure 
10 vessel disease. Analysis is applied to a certain angiogram to measure vessel dimensions; 
the results are different, when derived from different angiograms, depictmg the vessel in 
different instances of the heart cycle; QCA procedvire recommends the use of the end- 
diastole image. 

Three-Dimensional reconstruction of coronary vessels is also a method of 

15 evaluating vessel disease from a procedxure of conventional angiography. While it is well 
known and widely covered in the literature that 2D angiography has some inherent 
drawbacks, mainly presenting and measuring projected objects, which result in inaccurate 
measurements, methods are available for performing three-dimensional reconstraction of 
the arteries jfrom the series of the two-dimensional images obtained. In order to reconstruct 

20 a three-dimensional image of the arteries, it is necessary to obtain at least two two- 
dimensional images of the arteries in the same phase of the heartbeat, for example at 
diastole. Therefore, image acquisition is usually synchronized to an E.C.G signal. This 
procedure involves simultaneous recordings of Hie video signal from the X-ray camera and 
tiie patient's E.C.G signal. This procedure of ECG gating suffers from many drawbacks. 

25 For example, the ECG signal, in many cases, is hard to correlate to a desired state of the 
coronaries. Furthermore, when reviewing recorded angiographic films, often the E.C.G 
signal is unavailable. 

There are many additional cardiac and other medical procedures and 
measurements that involve identifying instances within the object's movement cycle and 

30 also involve quantifying this movement. 

Thus, it is desirable to quantify the organ movements. It is desirable to identify 
instances within the movement cycle. It is also evident that imaging a moving organ poses 
great difficulties for all modalities, impairing quantitative results and clinical assessment. 
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SXJMMARY OF THE INVENTION 

It is an object of iBvention to provide a method and system for unagmg 
moving organs and to quantify the organ movements. 

L present h^vention provides several methods and systems that relate to the 

evaluation of an organ motion. riftHna a cvcUc 

^ ™«n a sedes of ta«*.s depicting a moving obieC subject .o compos* -oU» 
a 0^0 con^onen. ™i a ^..ycUc component of lo,«. ^uenc, ftan 

cycUc component, the method comprising: 
in (2i) computing the composite motion; 

0.) con^uangthenon^ocompot^ast^in^ofmotionoveramonon 

cycle; and . 
(.) the noncycUc component ftom .he conrpositemouon so as .0 

obtain the cyclic component 
■me invention provides a «.vel method of evaluating fte cycUc motion of an 
organ ftom a series of images of an, source and provides implementaaons of s»^ 
Xd that decrease or eliminate motion arti^. SpecificaU,. «. P-e^-^ 
:ld and system for selecting opt^ai images fi.r the process » — « ^ 
I co«maries. We *nti« provide a method and system «>r replacmg fte need ft. ECG 

on Gatine bv an analysis of the heart movement. 

^ Amethllfcre^^emotionofanorg^ofaseriesofimagescompr^ 

ftefoUowingoperations-Amedica. imaging device acciuiresaseries of imagespr^ 
ll.th.\lmotioaThemotioniseiti«of,heorganchangingshape(evenh^y.- 
:Z manner, re^ i« «i.-l shape) or additionally of tire organ « 
„ .odon v^ the image cm angiogram. S.r «tample. it U very conmron to mo^ ^ 
p=tient.shedv«leim.gh«asare^..M^.hecoronarie.l^^^^^ 

If a non-:ycUc component is superimposed on the cycUc motion, the senes ot mi g 
::^:separJtirecycUcmotion,.m.henon^Ucm.tion.Once.^^^^^ 

of Ition are sep=^ ti>e cyclic motion can he <^ed^ ^.^^^ZZ 
3. now he used for direct measurements or can be investigated «>rd««*d^n. e^ 
^ftlr, tire motion cycle, in some implememations. titis investigation ™l.^^ ^ ^ 
i^e ftat is optimal in tire sense « it represet-s minimal motion and tims yields 
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ndnimal or no motion artifects. In other implementations, the cycUc motion investigation 
vviU point to several images, on which it is desired to perform an additional procedure or 
computation. We wiU specifically present two methods for quantifying the organ's motion. 
A preferred embodiment of this invention will include the foUowmg. We will 
5 present a method and system for identifying the optimal image - (an image depicting 
minimal coronary movement) from a series of coronary cine-angiogtams. We will present 
a method that separates the heart movement from other movements apparent in the series 
of angiograms. As a better alternative to the ECG Gating procedure, we suggest to search, 
usmg search algorithms such as are known in the art, the graph of the heart motion for the 
10 end-diastole position, being the position that represents minimal movement. We correlate 
this end-diastole position to the appropriate angiogram. This selected angiogram is the 
optimal image to participate as an input to the procedure of three-dimensional 
reconstruction of the coronaries. It is optimal in the sense that the 3D model is most 
representative of the vessels that are hnaged. Thus, vessel measurements derived from the 
15 model are most accurate. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In order to understand the mvention and to see how it may be carried out in 
practice, a preferred embodiment wiU now be described, by way of non-limiting example 
only, relating to determination of an optimal image within a series of images depicting 
20 heart motion, and with reference to the accompanymg drawings, in which: 

Fig. 1 provides an example that simpfy demonstrates that the integral of a cycUc 
motion, being a motion of an object that starts and ends in tiie same position, is zero; 

Fig. 2 is a flow chart showmg tiie principal operations carried out in accordance 
with a general method according to the invention for identifying an optimal image from a 
25 series of images depictmg a moving object; and 

Fig. 3 is a flow chart showing the principal operations carried out in accordance 
with a specific implementation of the metiiod shown in Fig. 2. 
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DETAILED DESCRimON OF EXEMPLARY EMBODIMENTS 
General principles 

The invention wiU be described with particular reference to Ihe determination of 
an optimal image within a series of images depicting heart motion possibly containing 
5 »noise" caused, for example, by shifting of the operating table on which a patient is 
disposed. Before doing so, some general algorithms wiU first be described. 

Fig. 2 is a flow chart showing the principal operations carried out by a method 
according to the invention for identif/ing an optimal image firom a series of images that 
depict a moving object. 

10 Fig. 3 is a flow chart showing a preferred embodiment of such a method for 

identifying optimal image firom a series of coronary cineangiography images; this image 
bemg the input for a three-dimensional reconstruction of a the coronaries. 

A series of images is received as input to firom any imaging source. These images 
depict a moving organ subjected to two types of motions. The first is a cycUo motion of 
15 the object itself, meaning that, within a certain time firame, tiie object restores its ori^ 
shape and position. The second is tiie motion of the object witiun tiie scene (image), 
meaning that the object changes position due to change in the imaging position. In the 
preferred embodiment of tiiis method shown in Fig. 3, the images are a series of coronary 
angiographic images, obtained during a catiieterization procedure. The cycUc motion is the 
20 heartbeat and the second motion could be, for example, movement of the C-ARM table, 
causmg a shift of tiie imaged coronary vessels in tiie image. 

First, tiie overaU motion is computed for all sequence of images, using any 
method, for example optical flow or phase correlation. 

If tiie cycUc period is unknown, tiien tiie cycle period is computed firom tiie 
25 overall motion data. One mettiod of doing so is by spectral analysis. The non-cyclic 
motion is computed, using overall motion and known or computed cycle period. A 
preferred embodiment of a known cycle period is tiie period of a cardiac cycle extracted 

fi^m analysis of tiie ECG signal. 

The non-cycUc motion is subtracted firom tiie overall motion to obtain tiie cycUc 
30 motion. In tiie preferred embodiment shown in Fig. 3. tiie heartbeat motion is obteined by 
subtracting tiie non-cycUc motion (mainly attributed to movement of tiie patient's bed) 
firom the overall motion. 
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The motion values, especiaUy those describing the cyclic motion, can now be 
used for direct measurements, for example, for cardiac wall motion analysis . 

To this end, there is defined an event related to the motion function. For example, 
in the preferred embodiment sho^^^ in Fig. 3 , this event could be the mmimum mstance, 
identifying the image with least coronary motion, thus being the optimal unage for three- 

dimensional reconstruction. 

If the event is unique, then the instance (image) that matches this event is found. 
Otherwise, all matches for the event are found, and from this list of candidates the one 
instance that matches a heuristic rule is selected. In the preferred embodiment, the event of 
0 least arteries motion could be unique if an approximation to the instance is extracted b^ 

analysis of the ECG dgnal (R peak is an approximation to the end-diastole instance). 
Otherwise, if such an approximation is not available, the event of least-motion rs not 
unique, smce it is matched by both end-systole and end-diastole. Thus, both instances of 
the least-motion event are found, and the end-<iiast«le motion is identified by the rule that 
1 5 it depicts the arteries most relaxed, as opposed to least relaxed for end-systole motion. 

The unage that correlates to the identified instance is the optimal unage. For 
example, as in the preferred embodiment, the unage that correlates to the event of least- 
motion, most relaxed state of the arteries is opthnal for three-dimensional reconstruction. 

20 Method for estimating the organ's motion 

In the above embodiments, motion of the organ is computed ftom a series of 
in^ges (frames). Altixough tixe manner in which is this is done is not itself a featiire of the 
invention, for the sake ofcompletenesstiiere will now be described ways in wMchtius can 

be done. 

25 First, we suggest an algorithm, where tiie number of images (frames) per cyclic 

motion of tixe organ is kno^ Ti^ parameter is usually known (for example, the cardiac 
cycle length is easUyaoiuired via interfecing to the ECG unit intiiecatiaeterizationro 

Nevertheless, we will later obviate the need for knowing tiiis parameter. 

Let IMj, IM2... IMn be n images that include, each, an organ that is m cychc 
30 motion. Let m be the number of images per cycle. 

Any m+1 unages, IMi, M.... IM«, mWi, form a fiJl cycle (for tiie sake of 
simpUcily it will be assumed tiiat m is an even number). Differences between frames m 
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factors. 



10 



this sequence are attributed to Ihe organ's cycUc motion, but are also attributed to otHer 

If only cyclic motion is present, the first and tbclast images in this sequence must 

be identical, lMi=IMm+i. 

Difference between images representing composite motion can be computed, as 
known in the art, by, for example, optical flow or by applying phase correlation 
computation to pairs of successive images IM. and IM.. ie{l..m}. The result of thrs 
computation (for example the result of phase correlation) is described dXt A^i and pi, 
where dXi and dYi are the shift between images (assuming a substantial part of the same 
pattern is present in both images) in X and Y axes respectively and p. is the correlation 
grade, may be used to enhance the further described algorithms. 
Let us define and compute the motion mtegration as: 



for taage W is equal to to motion integral for image i pte shift between images i and 
i+J as computed by the phase correlation. 

It is mathematically understandable that the integration of a cycUc motion, from 
ixnage IM. to IM... is zero - if eo. object starts and ends m the same position, then the 
, integration of the object movements (onX and Y axis) is zero (as shovminFrg. 1). Ilius, 
if only cyclic motion is present, CXm+uYnri-i)=<Xi»Yi)=(0.0). 

Let CXncYnc) be the integral of the non-cycUc motion, 
CXiic,YNc) = (XiiH-i,Ymn), 
25 niis means that, given that the integral of cycUc motion is 0, (X™h,Y„^i) 

represent the residual motion that is attributed to non-cyclic movement. 

Assuming non-cyclic motion is consistent, or at tixe least ti»at its frequency is 
lower than the cycUc motion fiequency, we can subtract tins motion from the overaU 
30 motion; 

(Xi*,Yi*)=(Xi,Yi)-(XNC,YNc)*(i-iym. i=l,2,...,m+l. 
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Thus, we obtain the foUowing motion values. (XncYnc) are the values of the 
non-cycUc motion, and (Xi*,Yi*), f=1^,...,w+1, are the values, per frame i, of the cycUc 
motion. 

5 These values can now be used for direct measurements (such as cardiac wall 

motion, for example), and can be used as input to further processing, as further detailed 
below. 

We can obviate tiie requirement of knowing in advance the length of the cyclic 
motion by means of direct computation. The most common method of domg so is 
10 performing spectral investigation, based on Fast Fourier Transform, applied to a motion 
graph for the entire sequence, to identify the frequency of the cyclic motion. 

Method for obtaining the least motion image 

In many applications, it is desirable to identify tiie image with least motion (for 
15 example, least heart motion or least coronaries motion). In cases where the event of least 
motion, within the motion cycle is unique, tiien tiie least motion image is pointed to by the 
Tninimiim point on the motion differences gr£^h 
Let: 

20 Dij is motion difiEerences graph. Least motion instance is the minimal instance of 

Dy function. 

In other cases, vy^ere the least motion event is not unique within the motion cycle 
(for example, the cardiac cycle has two least motion instances - end-systole and end- 
25 diastole), we suggest the following method. 

If an initial approximation for tiie least motion image is known (for example, the 
vicinity of the end-diastole rniage, within the cardiac cycle, is easily identified by the R 
peak, taken from tiie ECG signal), then we will find tiie first extieme point, which is most 
distant to the approximated least motion image, meaning: 
30 If IMf is the approximation for the least motion image, then the first extreme 

pomt is De^ = max {Di,F} for all i-l ..m+l . 

Least motion image - IMlm - is determined as most distant from image 1Mb, 
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Dlm^b = max {Dj^} for all /=1..ot+L 

We can relieve the reqxiirement for knowing in advance an approximation for the 
least motion image by means of direct computation. If indeed the least motion instance is 
5 not unique, we can use heuristic criteria for distinction. For example, within a sequence of 
angiograms, depicting a cardiac cycle, it is easy to distinguish between the end-systole 
instance and the end-diastole instance, both representing least motion, since the end- 
diastole mstance is identified by presenting the coronaries in maximal spreading, while the 
end-systole instance is identified by presenting the coronaries in minimal spreading. 

10 

Preferred Embodiment. 

We suggest a preferred embodiment for an application of three-dunensional 
reconstruction of coronary vessels fiom a procedure of conventional angiography. In order 
to reconshiict a three-dimensional image of the arteries, it is necessary to obtain at least 

15 two two-dimensional images of the arteries in the same phase of the heartbeat, for 
example at end-diastole. Therefore, image acquisition is usually synchronized to an ECG 
signal. This procedure involves simultaneous recordings of die video signal fix)m tiie X- 
ray camera and tiie patient's ECG signal. We present here a novel method for identifying 
the end-diastole instance, equivalent to ECG-gating, without relying solely, if at all, on the 

20 ECG signal. 

Let IMi, IM2... IMn be n images of a catheterization-acquired run. 

Let m be the number of fi:ames per cardiac cycle, either known in advance or 
computed as detailed in the above-described mefliod for estimating the organ's motion. 
25 Let IMk be the approxhnate location of ©ad-diastolic frame within the cycle, 

either known in advance or heuristically identified as detailed in tiie above-described 
method for obtaimng the least motion image. 

IMk-mtt, IMic-ma+i, IM k-m«+i • • . ^k-mji+m form a full cardiac cycle (for the sake of 
30 simplicity, let us presume that m is an even number). Differences between fi-ames in this 
sequence are attributed to heart motion, but are also attributed to bed motion, iodine 
propagation and several other reasons. If only heart motion were present, the first and the 
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last images in this sequence - IMk.„^ and Mk^+m - must be identical, since the motion of 
the heart is cyclic. 

For the sake of simplicity, let us renumber the sequence as 

IMi,IM2...IMm,IM„ri-l. 

As noted above, if only heart motion is considered then IMi=IMmn. Also, the 
end-diastolic renumbered fiame is TMnn+u ^Mch is an approximation for the least motion 
fiiame. 



Apply Phase correlation computation to pairs of successive images IMi and IMi+i, 
ie{l..m}. The result of the Phase correlation is described dXi ,dYi and pi, where dXj and 
dYi are the shift between images (assuming most of the same pattern - coronary tree or 
part of the coronary tree - is present in both images) in X and Y axis respectively and pi is 
the conrelation grade, pi may be used to enhance the further described algorithms. 
15 Now, of all the reasons that attribute to the differences between successive 

images, the most significant contributory fector to such differences - sometimes more than 
heart motion itself - is bed motion. 

Integration of cardiac motion, firam image IMi to IMm+i, is zero - 
(X„rt-i.Y,ttfi)=(Xi,Yi)=(0,0). 



20 



25 



Let (Xb,Yb) be the integral of the bed movement, 
C^b.Yb) = (Xm+l,Yni+i), 

meaning that, given that the integral of cardiac motion is zero, (Xm+i,Y„rt-i) represents the 
residual motion that is attributed to bed movement 

Assuming the bed movement is consistent (meaning the physician is moving the 
bed in a general constant direction), or that, as a weaker constraint, the bed movement is 
slower than heartbeat, we can subtract this movement from the overall movement: 

CXi*,Yi*)=(Xi,Yi)-(XB,YB)*(i-l)/m, i=l,2,...,m+l. 



The frame with mmimum arterial motion is pomted by tiie extreme point on 
(X,Y) curve. 
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Let: 

We can determine the end-systole point S, which is the one most distant from the 
approximated end-diastole point, meaning: 

5 Ds,m/2+l = max {Di,my2+1 } 

Minimum motion point - end-diastole, ED - is determined as most distant from 
systole point: 

Ds^ = max {Ds^}. 

10 Selecting the IMed image per sequence of cine-angio images for the process of 

three-dimensional reconstruction will provide the optimal result, in terms of accuracy and 
precision, for the reconstruction and for vessel analysis. 

In the method claims that follow, alphabetic characters and Roman numerals 
used to designate claim steps are provided for convenience only and do not imply any 

15 particular order of performing the steps. 

It will also be understood that the system according to the invention may be a 
suitably programmed computer. Likewise, the invention contemplates a computer program 
being readable by a computer for executing the method of the invention. The invention 
further contemplates a machine-readable memory tangibly embodying a program of 

20 instructions executable by the machine for executing the method of the mvention. 



